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V Distortions of the magnetic field, such as those caused by susceptibility artifacts and peripheral magnetic field warp- 
ing, can limit geometric precision in the use of magnetic resonance (MR) imaging in stereo Lactic procedures. The 
authors have routinely found systematic error in MR stereotactic coordinates with a median of 4 mm compared to com- 
puterized tomography (CI) coordinates. This error may place critical neural structures in jeopardy in some procedures. 
A description is given of an image fusion technique that uses a dhamfer matching algorithm; the advantages of MR 
imaging in anatomical definition are combined with the geometric precision of CT, while eliminating most of the 
anatomical spatial distortion of stereotactic MR imaging. 

A stereotactic radiosurgicaJ case is presented in which the use of MR localization alone would have led to both irra- 
diation of vital neural structures outside the desired target volume and underdose of the intended target volume. The 
image fusion approach allows lor the use of MR imaging, combined with stereotactic CT, as a reliable localizing tech- 
nique for stereotactic neurosurgery and radiosurgery. 
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magnetic resonance imaging * computerized tomography 



Stereotactic localization for operative procedures 
has become a mainstay of neurosurgical practice. It 
is roost often accomplished with the use of compu- 
terized tomography (CT), which, under optimal circum- 
stances, has the advantage of millimeter precision and 
geometric fidelity. However, CT compares poorly to mag- 
netic resonance (MR) imaging in neuroanatomies defini- 
tion, most notably in the identification of structures in the 
brainstem, of nonenhancing lesions, and of anatomically 
normal structures in functional procedures. 8 * 12 ' 16 - 22 - 26 Per- 
formed with a stereotactic localizer, MR imaging can 
yield inaccurate spatial information because of the effect 
of magnetic susceptibility artifacts and field warping on a 
parJent-peripheral-fiducial system. Stereotactic localiza- 
tion errors arc potentially dangerous in the operating 
room, although other visual cues alert the surgeon to any 
discrepancy. Tn noninvasive stereotactic radiosurgery, 
however, there arc no obvious visual checks on stereotac- 
tic anatomical precision. The use of radiosurgery doses 
(1500-2500 cGy) in proximity to critical radiosensitive 
structures such as the optic chiasm or brainstem mandates 
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a strict appraisal of stereotactic verification when using 
MR imaging for localization. 

In 28 consecutive cases of radiosurgical treatment plan- 
ning based on both stereotactic MR imaging (using an 
MR-compatible localizer frame) and stereotactic CT m 
the same patients, we routinely noted three-dimensional 
offsets of 3 to 5 mm of MR imaging compared to CT 
reconstructions, which prompted this particular analysis 
and solution. After the problem of MR image shift was 
identified, the treatment volume was often modified to 
reflect a correction of the discordant MR and CT volumes, 
but the currently proposed image fusion algorithm is supe- 
rior in precisely localizing MR-defmed structures. A rep- 
resentative case will be presented demonstrating the dis- 
crepancy between stereotactic frame MR imaging and CT 
definition of structures, along with the correction through 
the image fusion algorithm. 

The technique of cross-modality fusion such as MR, 
CT, single-photon emission computerized tomography 
(SPECT\ and positron emission tomography (PET), com- 
bined with the ability to fuse patients' imaging data from 
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time points spread through the course of then illness, 
provides additional promise for diagnostic radiological 
evaluation of treatment effects and complications. More 
sophisticated analysis of imaging data may result from 
combining and carefully comparing these modalities in 
stereotactic space, especially when combined with stereo- 
tacticalJy directed histological examination. 

Clinical Material and Methods 

Image Fusion Technique 

Image fusion between nonstereotaede MR image and 
stereotactic CT scan volumes was accomplished by means 
of the chamfer matching technique described by our group 
in previous papers. 11>,5a The computer algorithms in- 
volved extracting those voxels that lie at the bone edges of 
the anatomically complex cranium in both the CT and MR 
volumes and automating their segmentation and registra- 
tion with each other. . . 

The MR imaging (without any stereotactic device) was 
performed on a 1.5-tesla MR imaging system (General 
Electric Medical Imaging Systems, Milwaukee, WI) using 
the standard head coil with 5-mm-thick sagittal T.-weight- 
ed images, 3 to 5 mm interleaved contiguous axial proton 
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density T-weighted images, and 5-mm nnsrieaved con- 
tiguous axial T f weigbted images Dost^dobmum. The 
CT data were acquired on a Somalom Plus CT system 
(Siemans Medical Systems, Inc., Iselm, NJ) or CT Htgh- 
ight Advantage 9800 Quick System (General He** 
Medical Imaging Systems) using the ^Rob^ 
Wells (BRW) stereotactic localization frame (Radionics, 
Inc., Burlington, MA) fixed to the patient s scalp. The 
stereotactic CT scan used 3- to 4-mm-thick contiguous 

S,, The first processing step involved the , segmentation ^>f 
those voxels that lie on the surfaces of *e bony anatomy 
in both image sets and identification oflhcir Jn^dtmra- 
sional positions (Fig. 1). The segmentation of bone in the 
CTvolSerelied on a simple bone threshold, whereas ^ 
segmentation in MR volume relied on a spectral aialyse 
of voxel values;* both are automatic and rapid .The .MR 
volume was subsequently transformed in the Rowing 
manner all voxels identified as bone-surface voxels were 
assigned the value of 0, and all other voxel values were 
replaced with a value denoting the closest distance of the 
voxel to a bone surface."' 31 This transformation represent- 
ed a distance transform of the original MR .mage volume, 
and the distance-transformed MR volume formed the tem- 
plate or chamfer for the match.'- 2 
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Fig. Z Illustrative case. Left: Gadolinium-ejihanced stereotactic T -weighted axial magnetic resonance (MR) image 
revealing a left acoustic neurinoma, obtained with the MR-fidurial rod localizer in place. The orange-filled contour indi- 
cates the intended 80% isodose surface for the radionirgical ircatmeni (80% = 1500 cGy) and includes the entire tumor. 
Center; Axial bone window stereotactic computerized tomography (CT) scan indicating the same 80% isodose contour 
(in orange) as it relates to the internal auditory canal. Right: An axial image fusion MR image (the small white dots rep- 
resent booe edges from the CT scan used lo fuse the image with the bone visualized on MR) showing that the true iso- 
dose contour is displaced posteriorly by 4 mm compared with the original stereotactic MR image. This image distortion 
would liavc led to unrecognized dose distribution into the anterolateral pons and middle cerebellar peduncle, leaving the 
1 anterior aspect of the tumor underfilled- Note that fiducial rods from both CT and MR frames are reproduced 



If a bone voxel identified on CT was placed in the MR 
imaging volume at the location given by the CT voxel 
coordinate, an MR voxel and value would be found that 
denoted the distance from the CT voxel to tbe closest MR 
bone edge. If the CT and MR imaging were perfectly 
aligned and the segmentation weTC ideal, this value would 
equal zctO. All CT voxels were then considered and an 
attempt was made to minimize the sum of all distances 
obtained in the MR image volume by applying Ihc trans- 
formation operations of translation, rotation, and scaling 
between the CT and MR coordinate systems. The trans- 
formation that minirmV-cd the overall sum of distances was 
presumed to be the best alignment between the two vol- 
ume sets/- 15 ' 17 Using a Monte Carlo technique to vary 
parameters around the initially assumed model of a "true" 
image match, a mean cost function combined with a 
Downhill Simplex optimization procedure yielded the 
lowest number of false positives (1.8%). Accuracy was 
better than 1 mm and the capture range for the two coor- 
dinate systems was Jess than 6 em. 25 

Results 

The actual matching procedure described above was 
very rapid and took approximately 30 seconds on current 
HP 9000/755 workstations (Hewlett-Packard, Inc., Palo 
Alto, CA), The accuracy of the match was verified for 
each patient and involved a detailed comparison along 
arbitrary planar reconstructions (coronal, axial, and sagit- 
tal sections) for the alignment of the internal anatomy. If 
the match was not sufficiently accurate, the procedure 
allowed an optimization of the parameters of the segmen- 
tation process lo minimize the discrepancy. 

The fusion resulted in the alignment of the nonstcreo- 
tactic MR image volume to the stereotactic CT scan vol- 
ume. Hie CT volume allowed a first-order calibration 
of the distortion effects in the MR image for a patient. The 



correction did not rely on external calibrations or statisti- 
cal inferences based on phantoms. The fusion created a 
new data set from the original stereotactic CT volume and 
replaced the CT pixel value with the MR pixel value at 
that location. Thus, this new data set was an MR imaging 
data set that used the distortion-free CT stereotactic fidu- 
cial markers to achieve stereotactic localization. 

The qualily of fit of the final image fusion data set could 
be demonstrated with many soft tissue and bone features. 
Our software allowed creation of a small window that 
could be rapidly moved around on the CT planar image to 
show the corresponding MR image and demonstrate 
goodness-of-fit of any anatomical structures. The qualily 
assurance protocol depended on this comparison between 
stereotactic CT and the fused MR data that were acquired. 
In general, image shifts of greater than 1 mm were seen 
only at the tissue-air inicrface. Stereotactic CT-MR im- 
age fusion for localization of external surface features on 
a patient therefore yielded an unsatisfactory result 

Illustrative Case 

This 59-year-old woman presented with progressive 
hearing loss over 2 years due to an acoustic neurinoma 
and was selected for treatment with radiosurgery. Axial 
MR images with the stereotactic localizer ring in place 
demonstrated displacement of the MR tumor image poste- 
riorly, directly into the anterolateral brainstem (Fig. 2). 
Dose-volume histogram analysis of both treatment plans 
(using the MR stereotactic frame and MR image fusion) 
was reviewed. Based on the plan of the MR stereotactic 
frame-defined tumoT, 100% of the tumor volume was 
covered by 80% of the total dose (prescribed as 1500 i cGy 
to the 80% isodose surface). However, because of the 4- 
mm posterior displacement of the 0.96 cc ; target volume 
demonstrated via image fusion, only 83% (0-80 oc) of the 
actual tumor volume was covered by the prescribed dose. 
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Fig. 3. Dosc^volume histogram (DVH) from the case illustrat- 
ed in Fig. 2. Die curve on the right (with the steepest shoulder) is 
the intended DVH, with the typical steep shoulder for a single 
isocenter radiosurgfcal case with minimum tumor dose inbomo- 
gcncity and complete tumor coverage. The right vertical line indi- 
cates the minimum peripheral tumor dose (1500 cGy ) prescribed to 
the 80% isodosc distribution. The left curve (with a more gradual 
shoulder) indicates the actual treatment DVH, with the vertical line 
indicating the 55 % feodose distribution (not the 80%) receiving the 
prescribed dose. This resulted in 0.80 cc of the 0.96-cc tumor vol- 
ume (83%) receiving the intended 1500 cGy, leaving 17% of the 
tumor volume (the anterior aspect shown in Fig. 2 Hgte) exposed 
to a potentially subtherapeutic dose. 



The anterior 17% of the tumor volume, therefore, would 
receive less than the prescribed dose if the image fusion 
correction was not made (Fig. 3). Without appropriate 
correction for this MR image distortion, the dose to 
the anterolateral pons and cerebellar peduncle would be 
greater than expected. 

Discussion 

Imaging studies in which spatial relations are quantita- 
tively accurate are a prerequisite for modern stereotactic 
techniques. Because data acquisition with CT scanning 
was obtained via x-ray photons, whose paths are not sub- 
ject to measurable deflection by the elements involved in 
producing an image, distortion is inconsequential with a 
still subject. 9 * 19 The magnetic fields produced within the 
MR imager, on the other hand, are not necessarily free of 
such influences. For diagnostic imaging this is not a prob- 
lem because the primary concerns are the relationships 
between adjacent structures. For imaging in conjunction 
with stereotactic procedures, comparisons are made be- 
tween distant structures, and the reliability of MR imaging 
for this application has been questioned* 101 * 

An MR localization in combination with a stereotactic 
frame relies on fiducial markers, calibrated with respect to 
the frame, which are imaged with the patient 5 These fidu- 
cial markers are used to generate a transformation from 
the image-modality coordinate system to the stereotactic 
coordinate system. Stereotactic localization based on CT 
is a highly accurate procedure with millimeter range accu- 
racy, in optimum circumstances. An MR image often pro- 



vides superior anatomical definition of intracranial targets 
compared with CT, but suffers from spatial distortion sec- 
ondary to magnetic field warping, susceptibility artifacts, 
and chemical shift effects. 

Stereotactic localization using MR imaging suffers from 
lack of geometric fidelity in the reconstructed images. The 
manufacturer, in fact, advises against the use of MR imag- 
ing for applications demanding geometric precision* and 
states that the overall accuracy is 2% of the field-of-view 
(Radionics, Inc.; personal communication, 1994). 

Some reports claim that distortion of MR images is not 
significant in stereotactic localization, whereas others re- 
port Uncar distortions on the order of 4 ram. 14 ' 33 A recent 
study by Kondziolka, et a/., 14 concluded that the magni- 
tude of MR image distortion was less than one pixel on 
accompanying CT scans and was thus insignificant. Other 
studies have reported significant errors, as great as 5 mm 
on average, between MR and CT images. 3 -" 5 - 23 - 26 

In our experience with 28 radiosurgery patients ana- 
lyzed simultaneously with both stereotactic CT and ste- 
reotactic (frame-based) MR imaging, three-dimensional 
distortions of 4 mm (median range 3 to 5 mm) were noted. 
Hie MR displacement was in a posterior direction on axial 
images and a superior direction on coronal images. 

Radiosurgery offers significant benefit by enabling 
dose gradients from 80% to 10% (of maximum dose) over 
approximately 6 to 8 mm. Given that the primary indica- 
tion for the addition of MR imaging to CT scans in these 
radiosurgery cases was proximity of the lesion to the optic 
chiasm (the most radiosensitive of intracranial structures), 
this amount of spatial discrepancy was quite alarming 
Our images of phantoms also consistently showed gross 
misalignment of fiducial rods with MR imaging. 15 

A number of factors may contribute to the inhomoge- 
neity of the magnetic field and, thus, to distortion in the 
MR image Fluctuations in power supply or temperature 
and the placement of ferromagnetic structures in the vicin- 
ity of the magnet can afreet the geometry of the magnetic 
field. 6 * 7 Susceptibility artifacts at air-water and air-fat 
interfaces lead to unavoidable spatial distortions. Mag- 
netic susceptibility artifacts are of greatest concern in the 
imaging of fiducial rods, because they have sharp materi- 
al interfaces and are located far from the center of the 
magnetic field in which field warping is greatest 7 * 19 The 
air-rod interface can lead to significant susceptibility arti- 
fact with rod distortion and, therefore, alterations tn the 
three-dimensional coordinate system used to define ana- 
tomical localization. 

Another source of artifact is the chemical shift-induced 
spatial misregistration between water and lipid signals. 
The use of petrolatum for rod material, although useful for 
generating a strong signal in typical imaging schemes, 
introduces further spatial misregistration because of 
chemical shift effects. In routine MR imaging, the chemi- 
cal shift differences between protons bonded to carbon, as 
in fat and petroleum gels, and protons bonded to oxygen, 
as in water, lead to spatial displacements between these 
two materials in both the frequency-encoding dimension 
and the slice-selection dimension 27 In brief, the intrinsic 
and extrinsic mechanisms of spatial distortion in MR 
imaging are numerous and difficult to account for quanti- 
tatively. 
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Despite these difficulties, MR imaging remains an im- 
portant and attractive modality for stereotactic procedures. 
Potential image distortion, with greater cost and scanning 
lime and less accessibility, arc often outweighed by the 
increased resolution afforded by MR imaging. Stereo- 
tactic MR imaging is often necessary, particularly with 
biopsies of small, poorly enhancing, or deep lesions or in 
certain functional neurosurgical procedures. 8 * 12 - 16 * 22 

Image fusion is a technique that combines often com- 
plementary information from two or more separate imag- 
ing studies into a single consistent imaging study. There 
are two commonly used image-fusion techniques. The 
first is based on systems of fiducial markers, in which 
markers visible with both modalities can be used to align 
the two images. 21 This method relies on only a small num- 
ber of data points, which inherently reduces its precision. 
The second is based on surface matching between vol- 
umes identified in both techniques. 1318 

Our group has described a method of image fusion 
between MR and CT via a chamfer matching technique 
that has been used extensively for radiosurgery. 15 This 
technique involves the automated matching of the sets of 
points consisting of the surface of the skull in MR images 
and CT scans (Fig. 3). In this method, the MR data from 
inside the skull are effectively combined with the spatial- 
ly accurate stereotactic CT data: the resolving power of 
MR imaging can be applied in conjunction with the fidu- 
cial accuracy and reliability of CT. Furthermore, in many 
cases the CT image can be used to verity points chosen 
with MR. Die method is very robust against partial vol- 
ume effects and uses the full volumetric information to 
rapidly fuse the image sets. U provides an interactive qual- 
ity-assurance procedure to verify the accuracy of the fu- 
sion on a per patient basis, and it relies on resampling both 
images in a uniform coordinate system, allowing arbitrary 
plane reconstruction. Obvious landmarks include the ma- 
jor arteries, ventricular spaces, and bone demarcations. 

Using the chamfer technique, the point of interest can 
be localized to the skull with MR imaging, and the skull 
can be localized to fiducial rods with CT, thus eliminating 
the effects of an MR artifact where it is greatest. We have 
used this technique in operative stereotactic procedures 
(both surgical and radiosurgical), thus minimizing MR 
spatial artifacts in cases in which this imaging modality is ■ 
necessary. 

The fusion process is dependent on calculations using 
an up-to-date computer workstation; computing time for 
completion of an image fusion is approximately 2 minutes 
using our workstation. Much more time is spent verifying 
the accuracy of the fused image, which involves expert 
evaluation of the results along three planes. Verification 
time is generally expected to be less than 1 hour. 15 

As stared above, most of the image distortion involved 
with stereotactic MR can be expected along the fiducial 
rods, because of their peripheral location and effects at the 
air-rod interface. Rousseau, er a/., 20 described a method in 
which four fiducial markers are attached directly to the 
skull. Because of the small number of referential points, 
error in target selection may actually be increased using 
this method; in addition, the air-skin or air-surface mark- 
er interface is highly susceptible to distortions. Chamfer 
matching offers a statistical matching of 5000 to 10,000 



separate MR-defined points on the skull for mapping into 
the stereotactic CT spatial dalaset 

Summary 

We have presented an example of image fusion using 
the chamfer technique in operative neurosurgery. For the 
lasr 3 years, all MR-guided procedures performed in our 
center have used image fusion of MR with stereotactic CT 
via this method, yielding more precise stereotactic local- 
ization of anatomical structures. For MR-guided neuro- 
surgical and radiosurgical procedures in which spatial 
localization accuracy of less than 5 mm is mandatory, 
image fusion offers an elegant solution. 
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